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ABSTRACT 

This paper presents findings of a study that examined 
the relationship between the performance (as measured by test 
results) of pupils in classrooms with fall-time teacher aides. The 
Student Teacher Achievement Ratio project (STAR) was implemented in 
Tennessee from 1985 through 1989 to study the effects of class size 
on student achievement and development in grades K-3. Data for this 
paper were derived from an analysis of data from Project STAR and its 
derivative studies. Project STAR compared the results of three 
situations: (1) small classes with a 1:15 teacher-pupil ratio (S 
condition); (2) regular classes with a 1:24 teacher-pupil ratio (R 
condition); and (3) regular classes with a full-time teacher aide (RA 
condition). In nearly all comparisons, the small classes had the. 
highest student test outcomes, followed by regular-sized classes with 
aides and regular-sized classes. However, pupils who were retained a 
grade before entering the STAR program benefitted most in their test 
scores from the RA condition and often least from the S condition. 
Implications are that retention fails to help students improve test 
outcomes and that small-class intervention does not remedy 
already-defined test-score deficits after students have experienced 
regular classes. Thirteen tables and an appendix containing 
statistical data are included. (LMl) 
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Introduction 

Although as part of the original Project STAR (1985-1989) analysis there was some 
consideration of the effects on pupil achievement and development of a pupil being in a "regular" 
class (a class with 22-26 pupils, with an average of 24) with a full-time teacher aide (designated 
RA), the literature review identified that, really, there was little research.on the topic of teacher 
aides and pupil achievement. In fact, there was surprising little research on the full range of 
teacher aides (use, training, effects, etc.). Since STAR was specifically a study of the effects of 
class size on pupil achievement and development in K-3, the major analyses were of class size, 
with the Teacher Aides questions treated secondarily. The basic STAR analysis and subsequent 
ancillary studies using the STAR database raised questions that have prompted additional 
attention to the "Teacher Aide Puzzle." This present paper reviews some of the issues but focuses 
almost exclusively on performance (test results) of pupils in classrooms with full-time teacher 
aides in Project STAR. 

Since the mid-1960s the concept and use of teacher aides - paraprofcssionals, teacher 
assistants — have grown. Federal support for teacher aides was found in education legislation 
and especially in ways that Local Education Agency (LEA) leaders chose to implement (then) 
Title I of the Elementary and Secondary Education Act, or ESEA (PL89-10). The various 
amendments to PL89-10 have produced new PL numbers, slightly reduced rules and regulations 
for implementation, and even a new designation (Chapter 1), but a mainstay of programs 
supported by the original Title I has remained the use of teacher aides or "parapros" in 
classrooms. 

For a program in such common usage, there is little serious research/ evaluation 
information available about teacher aides: demographics, preparation and training, use in 
classrooms and use school-wide, their influence on pupil achievement (this seems like a major 
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issue), etc. In some states teacher aides have strong associations (unions) that bargain for them 
for salary, fringes and working conditions. Teacher aides have been a part of some state 
education reform legislation. (E.g., in Tennessee the state provided at least one aide for each 
three teachers, K-3). Indeed, since much state legislation regarding education from the mid 1980s 
to now has been aimed at improving student test scores, one would infer that the emphasis on 
aides implies that state education reform advocates believed that there was positive benefit for 
student achievement (translate as increased test score outcomes) related to the use of teacher 
aides. This 1980s idea has a long legacy: a major purpose of Title I - and still of Chapter 1 - was 
to improve the education outcomes of "educationally deprived" students. Some 1965 debates in 
Congress regarding the passage of PL89-10 centered around whether this was education or 
poverty legislation. Given the increase in the use of teacher aides that can be traced to PL89-10, 
one might rightly ask if its continuation has been education or employment legislation. 
Expenditures for teacher aides adds credence to the claim that ESEA is employment related. 
What about the education issues? 
Purpose 

The purpose of The Teacher Aide Puzzle study is to provide a review and summary of 
theory, evaluation and research on the phenomenon of teacher aides, especially on the use of 
teacher aides in classrooms. Because of the dearth of research and evaluation data regarding 
teacher aides, and especially teacher aides related to student achievement, the paper relies 
heavily on data from Project STAR (Student Teacher Achievement Ratio) and its derivative 
studies and analyses, particularly the Lasting Benefits Study or LBS. Indeed, Slavin (nd) notes 
that the STAR database should be very useful in trying to understand the uses of teacher aides: 
"The longest and best-designed study on the use of aides was part of the Tennessee class size 
study" (p. 9). 

Project STAR (1985-1989) is best known as a major study of the effects of class size (1:13 - 
1:17 with an average teacher-student ratio of 1:15 vs 1:22 - 1:26 with an average ratio of 1:24) on 
pupil achievement and development (Finn & Achilles, 1990, Word et al. f 1990; Finn et al., 1989; 
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Nyeet al., 1992; and numerous other reports and articles by authors of the above publications). 
I Note: The 1:24 ratio in STAR may have been smaller than the average regular class size in other 
districts throughout America during 1985-89, the time of Project STAR. This was partly due to 
Tennessee's* average class size in early primary grades (K-3) at the time, and to the fact that when 
STAR researchers set up the STAR project, the design created conditions where the regular class 
in STAR schools had slightly fewer students than the average regular classes statewide.] 

In establishing Project STAR, the Tennessee legislature "hedged its bet" that small (S) 
classes (1:15) would do better than R classes. Since (S) classes would be expensive to implement 
statewide, the legislation required that the design contain the condition of a regular class with an 
aide (RA) dedicated to work full-time in the regular class. If this condition should provide 
improvements similar to those expected from the small-class condition, then the (RA) condition 
might be employed at a considerable savings. So, STAR really had three options [Small or (S), 
Regular or (R), and Regular with a Full-time Aide (RA)] and could as well have been considered a 
study of the effects on pupil achievement and development of using a teacher and a full-time 
teacher aide in a class of approximately 24 as being considered a study of the effects of a small 
teacher-pupil ratio (1:15). 

The LBS has followed STAR pupils from all three conditions as they exited STAR and 
entered regular classes in grade 4. Although the STAR pupils are in grade 8 (1993-94) the 
researchers have only completed the analysis of LBS data through grade 6. The present material 
includes a synthesis of research on teacher aides and their use, and it relies heavily on STAR and 
LBS, particularly due to the size, scope and design of STAR 
The Basic STAR Analyses (Summary) 

In STAR the unit of data collection was the pupil, but the unit of analysis was the class 
(the class average) performance on a norm-referenced test (NRT), the Stanford Achievement Test 
(SAT) series (K-3) and on Tennessee's criterion-referenced test (CRT), the Basic Skills First (BSF) 
for grades 1-3). [The design for the STAR analyses and the summary of results have been 
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reported elsewhere and appear here only as support in Appendices A and B (Finn & Achilles, 
1990; Nye e< al., 1991, 1992, 1993; Word et al., 1990).] 

Essentially these analyses favored the (S) condition (K-3) in all situations and in all years 
over the (R) and (RA) conditions in regard to pupil achievement. In K there was essentially "no 
difference" between (R) and (RA), and in grades 1-3 the pupils in (R) performed some better than 
the pupils in (RA), but the differences between (R) and (RA) results were less than the differences 
between (S) and other conditions. The LBS analyses followed pupils who had been in (S,R,RA) 
and for grades 4-6 the basic findings were the same as for K-3, but not quite as pronounced (Nye 
et al., 1991, 1992, 1993). Analyses are not complete for grade 7. Folger and Breda (1992) and 
Johnston (1992) did some follow-up analyses on the Teacher Aide Puzzle [a puzzle because 
intuitively one would expect pupils in the (RA) condition to outperform pupils in the (R) 
condition], and also reported results of a review of some teacher and aide interviews. 
Some Clues from Other Analyses 

Johnston (1992) reporting on an analysis of over 1000 interviews collected at year-end 
(1986, 1987, 1988, and 1989) from STAR teachers noted that "three generalizations emerged and 
served to organize our findings" (p. 5). Teachers who had a full-time aide or a small class 
reported "perceptions of: (1) increased time available for teaching and learning, (2) increased 
opportunity to individualize instruction, and (3) positive differences in the physical, social, and 
emotional classroom environment" (p. 5). However, in his treatment of the interview data 
Johnston (1992) did not make clear distinctions between the findings for the (S) and for the (RA) 
conditions. Yet, it is clear that the (RA) and the (S) conditions both improved the classroom 
environment and teaching opportunities. 

Researchers in STAR interviewed the 50 "Most Effective" teachers based on gain scores 
(pupil average gain on reading scores from the end of one grade to the end of another grade). 
Table 1 shows that the largest group of teachers in the "Top 50" (n=23 or 46%) was the (S) 
condition in the pupil range of 13-17. The next largest group (n=12 or 24%) was the RA group, 
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suggesting that, for this analysis at least, the (RA) condition resulted in good student 
achievement. 

Table 1. Interviews of 50 "Most Effective" STAR Teachers (Based on Gain Scores) 



Of those 50: N Class Size % 

8 22-25* (R) 16 

23 13-17 (S) 46 

7 18-21 14 

12 full-time 24 

aides (RA) 

50 100% 



*22-25 pupils is probably smaller than many regular classes nationwide, 1985-89. 



Teacher Aides and Pupil Achievement 

Slavin (nd) summarized clearly the initial findings in Project STAR related to pupil 
achievement, noting that the results seldom reached statistical significance when comparing (R) 
and (RA) class results, and that the effect size (ES) was never large enough to consider the results 
"educationally significant."* Several STAR analyses (e.g., Folgcr & Breda, 1992; Johnston, 1992; 
Word et al., 1990) reported information related lo the (RA) condition. Generally, results suggested 
that there was little benefit to student achievement when (RA) and (R) results were compared, 
but that there seemed to be some benefits to teachers and in terms of classroom "climate." (More 
on this later.) Slavin (nd) noted that "While research does not generally support the use of aides 
as they are most often used, there is evidence that aides implementing structured one-to-one 
tutoring. . .can. . .increase the achievement of. . .first graders" (p. 10). With this in mind, plus the 
nagging, common-sense belief that the use of teacher aides should be accompanied by increases 
in pupil achievement, the researchers returned to Project STAR, to the LBS, and to a review' of 
other studies on the use of teacher aides. Beca jsc in K there was essentially "no difference" 

* Effect size can be computed as x of X minus x of 0 * SD (pooled). Alternatively, if one expects 
that the treatment will influence the SD of X (and thus the pooled SD), one might consider ES = x 
of X minus >Tof 0 + SD of 0. While statistical significance is greatly influenced by (n), ES is not; 
some people discuss ES as "educational signficiance." 
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between results of (R) and <RA) and due to some procedure! issues, STAR rsearchers reassigned 
some (R) and (RA) pupils at random in Grade 1 . Most STAR analyses are (S) v. (R+RA) or (S) v. 
"other" in the Final Report. The analyses here look "inside" the basic and prevously-reported 
analyses. 

Review of STAR Finding s. In STAR, pupils and teachers were randomly assigned to 
S,R,RA conditions. Replacement for students who moved or additions of new students were also 
random but classes designated as S,R,RA remained as designated for purposes of analysis for K-3 
This provided a potential for classes to get "out of range." Tha { : is, in time a (S) class might have 
more than 17 (the stated maximum for S) or (R) and {RM classes might shrink to fewer than 22 
(the stated minimum for R and RA classes). A post hoc review of the frequency distributions of 
classes by numbers of pupils for STAR, K-l-2-3, is in Table 2. This shows that the (S) class might 
have more than n=17 and continue to be treated as (S) for analysis purposes and that the (R) or 
(RA) classes could have fewer than n=22 and still be counted as (R) or (RA) for analyses, in 
moving "out of range" (S) would get larger and (R) and (RA) would get smaller. 



Table 2 about here 



Note that all (S) classes in K were "in range" and that a few (R) and (RA) classes were "out 
of range," but that most out-of-range K classes were a teacher-pupil ratio of 1 :21 . For the (S) 
condition in grades 1, 2 and 3 there was some "drift" so the (S) condition included classes with 18, 
19 and even 20 pupils. For a quick check to see if the "out of range" phenomenon might influence 
the achievement results, a correlation (Pearson product moment) was run for class size and for 
the class average reading and math achievement scores for the (S) and the (R) classes only. A 
negative correlation would show that as class size increased, test scores decreased (Table 3). 
Given the STAR findings (Word et al., 1990) the negative correlations are not surprising. These 
correlations were not corrected either for "out-of-range 1 classes or by removing students who may 
have entered STAR by retention in grade or who may have had only one year of STAR exposure.^ 
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Table 3. Correlations of class size with reading and math (SAT) score- . K-3, Project STAR (1986- 
1989) using (S) and (R) classes only. 



Grades 

K 1 2 3 

Reading -.19** -.27** -.23** -.23** 

Math -.14* -.26** -.18** -.18** 



Significance *p < .05, **p < .01 

This consistent negative correlation suggests that the true picture of differences between 
(S) and (R) or (S) and (R+RA) or (R) and (RA) were probably understated in the original STAR 
analyses, or may have even been slightly skewed to the advantage of (R) over (RA). Thus, for the 
present study certain STAR achievement analyses were recomputed, often without the "out of 
range" classes. Additional analyses were employed to try to determine more about the teacher 
aide puzzle. 

Table 4 shows the correlation coefficients for the (RA) classes by size (ranges are in Table 
2) for pupil achievement in math and reading. These correlation coefficients are neither as large 
(or significant) nor as consistently negative as those for the classes without the teacher aides. 

Table 4. Correlations of class size with reading and math (SAT) scores, K-3, Project STAR 0 986- 
1989) using (RA) classes only. 



Grades 

K 1 2 3 

Reading -.11 -.05 .13 .08 

Math .04 .03 .08 .04 



Significance *p<.05, **p<.01 



Table 5 presents the STAR class average reading and math SAT scores and the percentile 
ranks for classes (S,R,RA) for grades K-3. These are the scores of all eligible pupils each year and 
there was no attempt to analyze further to determine if such things as number of years in STAR 
influenced the results or if one group or another (e.g., White or minority) seemed to benefit more 
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than another. Data in Table 5 generally show the (S) class benefit. The (R)/(RA) differences are 
less pronounced and often "mixed/' showing almost no difference in K, some small advantage to 
(RA) over (R) in grades 1 and 2, but a small advantage to (R) over (RA) in grade 3. 



Table 5 about here 



In Table 6 data are displayed not by class average, but by pupil average based on class- 
type placement in (S,R,RA) for grades 1-3 for SAT reading and math and by whether the pupil 
entered STAR in K or in grade 1. In 1985-86 when STAR began Tennessee did not require K, so a 
rather large new cohort (n=2278) entered STAR in 1986-87 in first grade. On the surface this 
analysis shows several trends. Scores in grades 1-3 are 8 to 19 points higher for pupils who had 
the K experience for all class types (S,R,RA) except for Black students in the Regular with Aide 
class condition (RA) in grade 1 (no difference) and in grade 3 (only 4 point difference). The RA 
condition seems to operate some differently for Black than for White pupils. Table 7 shows 
differences in summary form between pupil achievement in (S) and in (RA) by Race (BL/WH) in 
grades 1, 2 and 3 for those pupils who entered STAR in K and stayed from 1985-1988. 



Table 6 about here 



Table 7. Differences in White (WH) and Black (BL) pupil scores in (S) and (RA) classes, grades 1- 
3, for pupils who entered STAR in 1985-86 in K. (See Table 6 also.) 













Grade 














1 






2 






3 






WH 


BL 


Diff 


WH 


BL 


Diff 


WH 


BL 


Diff 


s 


543 


514 


29 


604 


575 


29 


633 


613 


20 


RA 


539 


493 


46 


602 


566 


36 


628 


604 


24 


Diff 


4 


21 




2 


9 




5 


9 
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While there seems to be little difference to a White pupil (entering STAR in K) by being in 
(S) or (RA) - scores favor (S) from 2-5 points from grades 1-3 - the Black pupil is more 
disadvantaged by being in (RA) when compared to (S) and especially so in grade 1 where the 
pupil in (RA) in K and 1 is 21 points below the pupil in (S) in K and 1 . 

Tables 8 and 9 show the impact of class size (S) and (RA) on students who were reatined 
in grade and those who were not retained. The importance of these comparisons resides in the 
ract that some people seem to believe that retention in grade may benefit pupils; others seem to 
believe that one path to remediating pupil "deficiencies" on standardized or other tests is to put 
them into small classes (e.g., into Chapter 1 pull-out classes) where pupils are grouped 
homogeneously more by inability than by anything else. The widespread use of Teacher Aides 
(TA) in Chapter 1 suggests that, at least in the minds of those who advocate and use TAs, their 
use should help students achieve better and, perhaps, reduce their deficiencies as measured by 
the tests. 

Data in Table 8 show that those retained and entering STAR in K as retainees (although a 
year older than those not retained) score considerably lower than the non-retained group at all 
grades (K-3) in both reading and math in all three class conditions (S,R,RA). Results within the 
groups are not as consistent. Among the retained grop (n=253) the ANOVAs never reach 
significance among scores of (S)(R)(RA) and, unlike the general results for STAR, pupils in (S) ao 
not do better than pupils in (R) and (RA) - in fact, although statistically N/S, the (R) group scores 
highest, and the (RA) group seems to be second. Among the non-retained group (n=6041 ) pupils 
in (S) do best in all situatios except reading, Grade 3. All ANOVAs reach significance (p<.01 ), but 
this is due to the large n in each comparison. Generally, the (S) condition has highest scores, 
followed by (R) and then (RA), a finding observed in the STAR multivariate analyses (Word et al., 
1990). The "fade" in grade 3 is similar to the findings for some Headstart evaluations. 

Data in TAblc 9 provide the CRT results for the BSF (a test tied closely to the Tennessee 
curriculum objecitves) for the pupils who enter STAR in K (1985) as retainees from K (1984-85) 
and as not-retained pupils. Results parallel those provided for SAT in Table 8 except that for 
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retained pupils the (RA) pupils score highest, followed by (R) and then (S), although the 
differences do not reach significance (p<.05). The trend is different for those not previously 
retained, with (S) consistently highest and (RA) and (R) following. Pupils previously retained 
seem to do better in the (RA) condition than in (R) or even (S). However, those who were 
previously retained score lower than non-retained pupils, and they never narrow the gap by 
being in the (S) condition. The (S) condition does not serve a remedial function for retained 
pupils. If begun in K, a full-time aide does seem to help the achievement of once-retained pupils. 

Data in Table 10 review the achievement of retained or non-retained entrants to K by race 
(black or white) by placement into (S), (R), or (RA) in grades 1 and 2 on the CRT for reading and 
math. Some key points seem consistent: the retained pupils are constantly below the non- 
retained pupils, white pupils usually outscore black but these differences are much less in the (S) 
condition for non-retained pupils and in the (RA) condition for retained pupils than for the other 
conditions in each comparison; for non-retained pupils the (S) condition is superior to the other 
conditions, but for retained pupils this is not always true. 

Tables 11, 12 and 13 present the same data for grade 1 entrants as Tables 8, 9 and 10 
present for K entrants to STAR. Generally, the results are quite similar for grades K and 1 : 

• Non-retained puipls outperform retained pupils on all tests. 

• (S) is best for non-retained, followed by (RA); (RA) often is best for retained, followed 
by (S). 

• (S) does not serve to remediate the performance of retained pupils. 

The BSF (CRT) data presented in Table 12 show (with few exceptions) the (S/ advantage 
generally for both retained and non-retained pupils in all grades in both reading and math, the 
constant advantage of non-retained over retained pupils, and the lack of any remediation effect of 
retention and of (S) for retained pupils. In most comparisons for both ;etained and non-retained 
pupils the (S) condition provided the highest outcomes, followed by (RA) and then (R). 

Table 13 provides the picture of class type (S,R,RA) impact for black and for white pupils 
in grades 1-3. There are mixed results for (S) and for (RA) - in some cases pupils in (S) di 1 better 
than pupils in (RA) and in other cases this trend was reduced. Two trends are clear: retained 
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pupils do progressively worse each year compared both to their prior scores and to non-retained 
pupils each year and the (S) condition docs not serve a remedial purpose. 
Some Tentative Conclusions 

Achievement data from groups of pupils in STAR have been disaggregated by a variety 
of pupil facts (e.g., race, retained or not retained, grade of entry to STAR as either K or 1 ) and by 
the class-type (S,R,RA) palcement experienced by the pupil while in STAR as an initial step to 
explore the relative benefit of a full-time teacher aide in the "regular" class. (Note that while this 
analysis looked at groups or categories of pupils, the basic STAR multivariate analyses were 
based on class averag es. In the present analyses, the results are primarily treated as descriptive 
and heuristic, not as answers. The present data will be used for future and expanded analyses.) 

Although this material focused on the value of a teacher aide in a regular classroom (RA) 
in Project STAR or with the STAR pupil database - the comparisons identified additional issues 
that may need future exploration. First, however, let's review the (RA) condition and fit this piece 
into the Teacher Aide Puzzle. 

In nearly all comparison explored in the present study the (S) condition resulted in the 
highest pupil test outcomes followed by the (RA) and then the (R) condition. There was one 
notable exception: pupils retained in grade before entering STAR (either in K or in 1 ) benefitted 
most in their test scores from the (RA) condition and often least from the (S) condition. (Note: 
This finding supports other work that shows a) that retention isn't a useful way to help students 
improve on test outcomes and b) that the (S) intervention is not a way to remedy already-defined 
test-score deficits after pupils have begun schooling in "regular" classes, but that the (S) condition 
may be a valuable tool in preventing large deficits.) 

More of the Teacher Aide Puzzle is to study aspects of teacher aides in the classroom 
other than just pupil performance. Some work has been begun (e..g, Chase & Mueller, 1993; 
Folger & Breda, 1992; Green, 1985; Johnston, 1992; Knox County, 1991; Slavin, n.d.), and the 
researchers are using this database as a starting place for future work with the STAR data relating 
to teacher aides. 
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Notes 

1 As STAR moved from K to 3, pupils who had been retained in grade in a prior year entered the 
STAR database. STAR began in 1985-86 in K and in 1986-87 the 1985-86 pupils (in not retained or 
mobile) were in grade 1. Note, however, that 1985-86 grade 1 pupils who were retained in grade 
1 now (1986-87) entered STAR and were distributed at random to S,R,RA. Was this important? 

In 1985-86 Tennessee did not have mandatory K. In 1986-87 there were 2277 new 
entrants to STAR. Of these new entrants, 1152 were 6.9 years old or older as of 10/1 /86 and were 
presumed to be retainees as they were at least one year older than "normal" dud to Tennessee 
rules for school entry. This seemed confirmed based on known retainees (n=253) entering STAR 
in K. Of this group 242 or 96% were 5.9 or older at 10/1/85. 
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Table 2, Distribution of STAR classes by grade (K-3) by designation S (Small), R (Regular), and 
RA (Regular and Aide). 
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A = range for (S); B = "out of range"; C = range for both (R) and (RA) classes. 
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Table 5. Class average scores and percentile ranks on SAT math and reading by class type 
(S,R,RA) for STAR, Grades K-3. 



SAT Scaled 
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Source: Word et a!., 1990, pp. 183-184. Results computed by class average and include all 
pupils/year, regardless of number of years in STAR. 
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